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Abstract. Let _fC be a fuU-dimcnsional convex subset of R". We describe a new polynomial- 
time Turing reduction from the weak separation problem for K to the weak optimization 
problem for K that is based on a geometric heuristic. We compare our reduction, which relies 
on analytic centers, with the standard, more general reduction. 



1. Introduction 

Let K he a. full-dimensional convex subset of R" containing a ball of finite 
radius centered at cq and contained in a ball of finite radius R. The separation 
problem for K is that of finding a hyperplane that separates a given point p 
from /v, or concluding that p ^ K . The separation problem is quite general in 
that it has been shown to be polynomial-time equivalent to other natural convex 
programming problems [TJ. One of these problems is the optimization problem^ 
which is the problem of maximizing a linear functional cF x over &\\ x £ K for a 
given c G K". 

It may arise in some applications that solving the optimization problem for 
K is more practically feasible than solving the separation problem directly, for 
example, if the extreme points of K are parameterized by a number of parameters 
that is significantly smaller than n} In such a case, it might make sense to solve 
an instance of the separation problem by solving polynomially many instances 
of the optimization problem, using a Turing reduction [2] from separation to 
optimization. Despite this practical philosophy, which the authors have adopted 
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^ Clearly this condition by no means guarantees that the optimization problem is easier. 
However, even if this is not the case, the optimization problem may still be more "feasible" 
than the separation problem if only because the former is better studied and thus software for 
it more readily available. 
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with some success to the (NP-hard j3|) quantum separabiUty problem^ EIEIj 
the main purpose of research into polynomial-time reductions among convex 
body problems is theoretical - to uncover the intrinsic beauty of the subject 
of convex programming algorithms, which historically marries physical intuition 
and mathematical rigor in a unique way. Our heuristics-based reduction is a fine 
example of this marriage. 

2. Convex Body Problems and Cutting-plane Feasibility Algorithms 

Let S{K, 5) denote the union of all balls of radius 5 with centers belonging to K, 
and let S[K, —5) denote the union of all centers of all balls of radius 5 contained 
in if, where the balls are defined with respect to the Euclidean norm. We now 
give the formal definitions of the basic convex body problems that will concern 
us, taken from [T].'^ 

Definition 1 (Weak Optimization Problem for K (WOPT(if))). Given 
a rational vector c G M" and rational e > 0, either 

— find a rational vector y G M" such that y G S{K,e) and c^x < <Fy + e for 
every x £ K; or 

— assert that S{K, — e) is empty. 

Definition 2 (Weak Separation Problem for K (WSEP(A'))). Given a 
rational vector p G M" and rational 6 > 0, either 

— assert p G S{K, S), or 

— find a rational vector c G M" with ||c||oo = 1 such that (Fx < cTp for every 
X € K. 

Let K' be a full-dimensional bounded convex subset of R" . 

Definition 3 (Weak Violation Problem for K' (WVIOL(A''))). Given a 
rational vector c G M" and rationals 7 and e' > 0, either 

— assert that (Fx < 7 + e' for all x G S{K', — e'), or 

— find a vector y G S{K' , e') with c'^y > 7 — e'. 

If 7 = — 1 and c is the origin G M", then WVIOL(iir') reduces to the weak 
feasibility problem for K' , denoted WFEAS(if'). By taking 5, e, and e' to be 
zero, we implicitly define the corresponding strong problems, denoted SSEP, 
SOFT, SVIOL, and SFEAS. Note that SFF,AS{K') is the problem of deciding 
whether K' is empty or finding a point in K' . 

^ The quantum separability problem is related to the problem of entanglement detection. 
Entanglement is a fundamental physical resource which plays a central role in quantum com- 
puting and quantum cryptography 

^ As a reminder, because computers use finite representation of numbers, the problems 
are suitably weakened with small accuracy parameters. As well, the rational field Q is used 
instead of the real field R, and the Zoo-norm (maximum norm) appears instead of the Z2-norm 
(Euclidean norm); however, these technicalities will not be carried through the paper. 
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Central to our reduction arc cutting-plane algorithms for WFEAS(A''), rel- 
ative to a WSEP(_ft'') oracle Ossei^k')- All such algorithms have the same basic 
structure: 

(i) Define a (possibly very large) regular bounded convex set Pq which is guar- 
anteed to contain K', such that, for some reasonable definition of "center", 
the center ojo of Pq is easily computed. The set Pq is called an outer approx- 
imation to K' . Common choices for Pq are the origin-centered hyperbox, 
{a; e K" : -2^ < Xi < 2^, 1 < i < n} and the origin-centered hyperball, 
{x : x'^x < 2^} (where 2^ is a trivially large bound). 

(ii) Give the center uj of the current outer approximation P to OssEPCic')- 

(iii) If OssEP(K') asserts G K"\ then HALT. 

(iv) Otherwise, say Ossepc/^') returns the hyperplane iTc^b such that K' C {x : 
(Fx < b}. Update (shrink) the outer approximation P -.^ P f) {x : c^x < b'} 
for some b' > b. Possibly perform other computations to further update P. 
Check stopping conditions; if they are met, then HALT. Otherwise, go to 
step (ii). 

The difficulty with such algorithms is knowing when to halt in step (iv) . Gener- 
ally, the stopping conditions arc related to the size of the current outer approx- 
imation. Because it is always an approximate (weak) feasibility problem that is 
solved, the associated accuracy parameter e' can be exploited to get a "lower 
bound" V on the "size" of K\ with the understanding that if K' is smaller than 
this bound, then the algorithm can correctly assert that S{K' , — e') is empty. 
Thus the algorithm stops in step (iv) when the current outer approximation is 
smaller than V. 

The cutting-plane algorithm is called (oracle-) polynomial-time if it runs 
in time 0(poly(n, log(i?'/e'))) with unit cost for the oracle, where R' is the 
outer radius of K'. It is called (oracle-) fully polynomial if it runs in time 
0(poly(n,i?Ve')). 

There are a number of such polynomial-time convex feasibility algorithms 
(see for a discussion of all of them). The three most important are the ellip- 
soid method, the volumetric center method, and the analytic center method. The 
ellipsoid method has Pq = {x ■ x'^x < 2^} and is the only one which requires 
"further update" of the outer approximation P in step (iv) after a cut has been 
made - a new minimal- volume ellipse is drawn around P := P Ci {x : c^x < b'}. 
The ellipsoid method, unfortunately, suffers badly from gigantic precision re- 
quirements, making it practically unusable. The volumetric center and analytic 
center algorithms are more efficient than the ellipsoid algorithm and are very 
similar to each other in complexity and precision requirements, with the analytic 
center algorithm having some supposed practical advantages.'^ 

The cutting plane {x : c'^x = b'} requires further definition: 

{b' < c'^ui 1 ( deep- cut ^ 

b' — c^uj > then the above is a < central-cut > algorithm. (1) 
b' > (Flo I I shallow-cut \ 

* To date, no one has implemented a polynomial-time cutting plane algorithm. For an im- 
plementation of a fully polynomial algorithm, see http://ecolu-info.unige.cli/logilab 
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Intuitively, deep-cut algorithms should be fastest. Ironically, though, except for 
the case of ellipsoidal algorithms (which are practically inefhcient), the algo- 
rithms that are provably polynomial-time are central- or even shallow-cut algo- 
rithms. 



3. Reduction via Heuristics 

Assume without loss that cq = 0. Our goal is to develop a new oracle-polynomial- 
time algorithm for WSEP{K) with respect to an oracle for W0PT(i5r) (running 
in time 0(poly(n, \og{R/S)))). We do this via a geometric approach, which differs 
from the standard approach covered in the next section. In this section, we 
ignore the weakness of the separation and optimization problems, as it obfuscates 
the main ideas; that is, we assume we are solving SSEP(_ftr) with an oracle for 

soPT(is:). 

Suppose we have an oracle Osoptc/c ) for the optimization problem over K such 
that, given a nonzero input vector c, Osoptc/c) outputs a point OsopxiKjCc) 
= kc G K that maximizes c^x for all x G K. An important step in developing the 
algorithm is noting that, given OsopTCic), the search for a separating hyperplane 
reduces to the search for a region on the (n — l)-dimensional surface of the unit 
hypersphere Sn (embedded in M") centered at the origin. For p ^ K, this region 
Mp is simply {c & Sn ■ c^kc < c^p} (see Figure QJ. 

The first observation is that, since K properly contains the origin, Mp is 
contained in the hemisphere defined by {x : p"^ x > 0}: 

Fact 1 For all m £ Mp, m^p > 0. 

Proof. Let m G Mp. Then rn^p > rn^k for all k G K. But the fact that the 
0-vector is properly contained in K implies that there exists k G K such that 
m^fc > 0. 

The second observation, Lemma^ is based on the following heuristic, which 
can be pictured in and M^. Suppose c, | |c| | = 1, is not in Mp (but is reasonably 
close to Mp) and that the oracle returns kc- What is a natural way to modify 
the vector c, so that it gets closer to Mpl Intuition dictates moving c away from 
kc and towards p, that is, add a small component of the vector {p — kc) to c, 
in order to generate a new guess c' — c + X{p — kc)/\\p ~ fcc||, for some A > 0, 
which we could then give to the oracle again (see FigureEJ. Incidentally, we have 
found that the following little program, which embodies this heuristic, actually 
performs well:^ 



^ We tested the program in M.^^ , where K is the convex hull of {aa* ^fif}* : a, /3 G C^, | |a| I2 = 
ll/3||2 = 1} (which is viewed as full-dimensional in R^^), where * denotes complex-conjugate 
transpose, and $5 denotes Kronecker product. This corresponds to the quantum separability 
problem for two qubits [5]. 
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Fig. 1. Tlie sets Mp and Kp in R^. Pictured in heavy outline is a set K in M?, where K := 
conv{(0, 1), (-1, 1), (-1, 0), (1, -2)}. A point p = (-7/8, -3/4) is shown as a heavy dot. The 
unit circle is drawn in a dashed line. The set Mp is the arc of the unit circle that the shaded 
pie-slice subtends; the set Kp is the shaded pie-slice. In two dimensions, the set Mp (Kp) is 
easy to construct. This construction has been illustrated: draw the two distinct lines through 
p that are tangent to K; the lines that determine the pic-slice are the two straight lines that 
are perpendicular to the lines through p. 



c :=p/||p||; d:=l; i := 0; 

WHILE (d > AND i < N) DO { 
kc OsopT(iir) (c) ; 

d c^kc — c^p; 

IF {d < 0) THEN { RETURN C } 

ELSE { c:= c + d{p- kc)/\\p- hW; c := c/\\c\\; i -.^ i + 1}}; 
RETURN "INCONCLUSIVE" 

This program can be regarded as an extremely simple heuristic for the sepa- 
ration problem when given an optimization subroutine (of course, it may give 
inconclusive results; in practice, one should set N as large as is practically fea- 
sible). 

Interestingly, the above heuristic can be formalized as follows. If c is not 
in Alp but is sufficiently close to Mp, then c, p, and kc can be used to define 
a hemisphere which contains Mp and whose great circle cuts through c. More 
precisely: 

Lemma 1. Suppose m e Mp, c ^ Mp, and let d :— (jp — kc) — Projg(p — kc). If 
m^c > then iji^d > 0. 
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Proof. Note that rri^a = mF {p — kc) — [cT {p — kc)]{m^c). The hypotheses of the 
lemma immediately imply that m?" [p — fcc) > and (F {p — kc) < 0. Thus, if 
wT' c > 0, then rn^a > 0. 

The lemma gives a method for reducing the search space after each query to 
Oson(K) by giving a cutting plane {x : a^x = 0} that slices off a portion of 
the search space. Our search problem can easily be reduced to an instance of 



a: 

















Fig. 2. Illustration of heuristic behind Lemma Q Continuing from Figure Q the unit vector c 
is a test vector that is close to but not in Mp. Evidently, adding a component of (p — fcc) 
to c moves it closer to Afp. This intuition also holds in 18"^. 



SFEAS(A"), where K' is 

:= [ConvexHuU (A/p U {0})] \ {0}. (2) 

The set ii'p, if not empty, can be viewed as a conc-like object, emanating from 
the origin and cut off by the unit hypcrsphere (see Figure^). The oracle Osoptca), 
along with Lemma ^ essentially gives a separation oracle for A'p, as long as the 
test vectors c given to Osoptca-) satisfy 

rn^c > for aU m 6 Mp. (3) 

How could we ensure that all our test vectors c satisfy (PJ? Recall Fact ^ 
which says that the set Kp is contained in the halfspace {x : p^x > 0}. Let i3„ 
be the origin-centered unit hyperball in M" and let oi := p/||p||. Thus, straight 
away, the search space is reduced to the hemisphere i?„n{x : ajx > 0}. The first 
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test vector to give to the oracle Osopt(k) is p/||p||, which clearly has nonncgative 
dot-product with all points in Kp and hence all m G Mp. By way of induction, 
assume that, at some later stage in the algorithm, the current search space has 
been reduced to P := i?„ H '"'iLii^; : afx > bi} by the generation of cutting 
planes {x : afx = bi}, where the a^, for i = 2,3, ... ,h, are the normalized a 
from h ~ 1 invocations of Lemma Q Let lu be the "center" of P, and suppose 
that this "center" is a positive linear (conic) combination of the normal vectors 
a.i, that is, 

h 

to = Ajfli, where A,; > for all i = 1, 2, . . . , /i. (4) 

i=l 

Then, by inductive hypothesis, this implies that rrv^uj > for all m G Mp. Thus, 
c :— ll}/\\uj\ \ is a suitable vector to give to the oracle Osoptcjc) and use in Lemma 
n Therefore, it suffices to find a definition of "center w of P" that satisfies 
in order that all our test vectors c satisfy © • Because we require Q , none of the 
feasibility algorithms mentioned in Section [21 can be applied directly. However, 
the analytic-center algorithm due to Atkinson and Vaidya j2I beautifully lends 
itself to a modification that allows to be satisfied. 

Reducing the separation problem for K to the convex feasibility problem for 
some K', while using the optimization oracle for K as a separation oracle for 
K' , is not a new concept in convex analysis. But the precise way that Lemma 
n generates each new cutting plane, incorporating the correction-heuristic, does 
not appear in the literature. This is likely because there is a more general way to 
carry out such a reduction, covered in the next section, which does not require 

4. Comparison to Standard Reduction 

Note that our reduction requires knowledge of Cq and R. A polynomial-time 
Turing reduction from WSEP(A') to WOPT(Ar) is well known - even when cq 
and R are unknown. One such (ellipsoidal) reduction is given in Theorem 4.4.7 
in however, it may be more general than is necessary. If R is known, then 
the standard way to perform the reduction of the previous section may be found 
in the synthesis of Lemma 4.4.2 and Theorem 4.2.2 in we outline it in the 
following paragraph. 

Definition 4 (Polar of K). The polar K* of a full- dimensional convex set 
K C M" that contains the origin is defined as 

K* := {c e R" : c^a; < 1 Vx G AT}. (5) 



^ The more general reduction was established by the early 1980s. Our reduction seems to 
require the result in which was not known prior to 1992. 
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If c e K* , then the plane -Kc.i = {x : (Fx = 1} separates p G M" from K 
when c"^p > 1. Thus, the separation problem for p is equivalent to the feasibility 
problem for Qp, defined as^ 

Q.p:^K*r\{c:p'^c>l}. (6) 

As mentioned in the previous section (and elaborated on in the next section), to 
solve the feasibility problem for any A'', it suffices to have a separation routine 
for K' . Because we can easily build a separation routine Ossepcqp) for Qp out 
of OssEP(K*), it suffices to have a separation routine Ossepck*) for K* in order to 
solve the feasibility problem for Qp.^ Building Ossepcqp) out of Ossepck*) is done 
as follows: 



Routine Ossepcqp) (y): 
CASE: p'^y < 1 

RETURN -p 

ELSE: p'^y > 1 

CALL OssEP(K*){y) 

CASE: OssEP{K*}{y) returns separating vector q 

RETURN q 
ELSE: OssEP(K*){y) asserts y £ K* 

RETURN "y G Q" 



It remains to show that the optimization routine OsopTCfo for K gives a separation 
routine Ossepcjc*) for K* . Suppose y is given to Osoptc/c), which returns k £ K such 
that y'^x < y^k =: b for all x G K. If 6 < 1, then Oc^sep{k*) may assert y G K* . 
Otherwise, Ossepc/^*) may return k, because tt^-^i (and hence TTk^b) separates y 
from K*: since k^y = b > 1, it suffices to note that fc-^c = c^k < 1 for all 
c G K* by the definition of K* and the fact that k G K. 

Figure 13 shows the relationship between the method of Section 01 and the 
above method, by illustrating that the set Kp (defined in |5J)) is just the radial 
projection of Qp onto B„ . Using "A — > B" to mean "i? Turing-reduces to A" , 
the standard reduction chain is 

WOPT{K) — > WSEP(A'*) ^ WSEF(gp) — > WFEAS(Qp), (7) 

where we indicate that the middle reduction requires knowledge of outer radius 
R. Our reduction, which is substantially less general, may be written 

WOFT(A') — > WSEF{Kp) ~5 WFEAS(/Vp), (8) 

(3) 

where the weak separation problem has been restricted (queries must satisfy 
the condition ^ of Lemma ^ and we note that the rightmost link requires, in 

^ Note that Qp is guaranteed not to be empty when p ^ K. For, then, there certainly exists 
some plane tt^/ y separating p from K. But since K contains the origin, b' may be taken to be 
positive. Thus T^c'/b',! separates p from K. 

^ We slightly abuse the oracular "O" notation by using it for both truly oracular (black- 
boxed) routines and for other (possibly not completely black-boxed) routines. 
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Fig. 3. The upper picture is a set ii" in R^, where K := conv{(0, 1), (-1, 1), (-1, 0), (1, -2)}. 
A point p = (—7/8,-3/4) is shown. The polar K* of K is shown in heavy outUne in the 
lower picture; K* = conv{(0, 1), (—1, 0), ( — 1, —1), (3, 1)}. The set Qp is the shaded polytope, 
bounded by the long-dashed plane {c : p-^c = 1}. The set Kp is the shaded pie-slice and is 
the radial projection of Qp onto B„ (whose boundary is shown as a short-dashed circle). The 
particular K and K* are taken from 



addition to knowledge of R and cq, a WFEAS algorithm whose centers satisfy 
(gl) (see Section IS)). 

The two reductions have similar structure; the novelty of our reduction lies in 
the way the cutting planes are generated, which is based on the heuristic: if the 
center uj satisfies (0J, then cutting near uj pushes the new center in the direction 
of the normal of the new cutting plane; but this direction is essentially [p — kc) 
(except with the projection onto c removed). Note that the normal of every new 
cutting plane depends on the given point p, whereas in the standard reduction 
it does not. These attributes tempt us to conjecture that our reduction performs 
"better" in practice when p ^ K (though not in any significant asymptotic 
sense). 
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Note that, even though Ossepcjc*), built on Osoptcjc), gives deep cuts tt^ i, it 
is not known how to utilize the deep cuts to get a polynomial-time algorithm 
using analytic or volumetric centers. Our cut-generation method in Section 13 is 
capable only of giving central cuts; but this does not, a priori, put it at any 
disadvantage (relative to the standard cut-generation method) with regard to 
polynomial-time analytic or volumetric center algorithms. In the next section, 
we briefly outline how our heuristic indeed yields a polynomial-time algorithm 
(justifying the Turing reduction in JH))). 

5. Analytic Centers 

Let P be the current outer approximation P := i?„ P| n^^j^jx : afx > bi}, 
as described in the second-last paragraph of Sectional Recall that we need a 
definition of "center uj of P" that satisfies Q . Define the analytic center w of P 
as the unique minimizer of the real convex function 

h 

F{x) := - ^ log(af X - b,) ~ log(l - x^x). (9) 

4=1 

The relation VF(w) = gives 

2 ^aju-bi' ^ ' 

which shows that uj, defined as the analytic center of P, indeed satisfies Q). 

Our algorithm is a modification of the one in [2| : we use a hypersphere for Pq 
instead of a hyperbox (i.e. we adapt the analysis to handle a convex quadratic 
constraint). We refer to [5j for details (which rely on results in pillUj ). but remind 
the reader of some of the algorithm's characteristics. The algorithm stops when 
the current outer approximation becomes either too small (volume-wise) or too 
thin to contain Kp. For this, a lower bound r > on the radius of the largest 
ball contained in Kp is needed. By exploiting the accuracy parameter S of the 
weak separation problem, such an r exists (and is derived in |S]). The actual 
algorithm is not as straightforward. For instance, it is a shallow-cut algorithm 
{bi < 0) so as to keep the analytic center of the old P in the new P and the new 
center close to the old center. As well, cutting planes are occasionally discarded 
so that h does not exceed some prespecified number. 

Incidentally, it is an open problem whether there exists a polynomial-time, 
analytic center algorithm for the convex feasibility problem that does not require 
shallow cutting. It has been suggested by Mitchell |lllll2j that central cutting 
can be used in the Atkinson- Vaidya algorithm, if certain techniques from 
are employed to compute the new analytic center. However, from correspondence 
with Mitchell and Ye it is unclear whether modifying the Atkinson- Vaidya 
algorithm in this way retains the polynomial-time convergence: while it is clear 
that a new analytic center can be efficiently computed when central cuts are used. 
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it is not clear that all the other delicate machinery in the convergence argument 
emerges unscathed. If central cuts may indeed be used, then the worst-case 
precision requirements of our algorithm are significantly reduced [Hj- 
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